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Abstract 

We study the statistical properties of the counting function of lat- 
tice points inside thin annuli. By a conjecture of Bleher and Lebowitz, 
if the width shrinks to zero, but the area converges to infinity, the dis- 
tribution converges to the Gaussian distribution. If the width shrinks 
slowly to zero, the conjecture was proven by Hughes and Rudnick for 
the standard lattice, and in our previous paper for generic rectangu- 
lar lattices. We prove this conjecture for arbitrary lattices satisfying 
some generic Diophantine properties, again assuming the width of the 
annuli shrinks slowly to zero. 

One of the obstacles of applying the technique of Hughes-Rudnick 
on this problem is the existence of so-called close pairs of lattice points. 
In order to overcome this difficulty, we bound the rate of occurence of 
this phenomenon by extending some of the work of Eskin-Margulis- 
Mozes on the quantitative Openheim conjecture. 

1 Introduction 

We consider a variant of the lattice points counting problem. Let A C I 2 be 
a planar lattice, with det A the area of its fundamental cell. Let 

N A (t) = {x E A : \x\ < t}, 

denote its counting function, that is, we are counting A-points inside a disc 
of radius t. 
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As well known, as t — > oo, N A (t) ~ d^~\^ 2 - Denoting the remainder or 
the error term 

it is a conjecture of Hardy that 

|A A (t)|« e t l ' 2+ \ 

Another problem one could study is the statistical behavior of the value 
distribution of Aa normalized by y/t, namely of 

Heath-Brown |HBj shows that for the standard lattice A = Z 2 , the value 
distribution of Fa, weakly converges to a non-Gaussian distribution with 
density p(x). Bleher [BL3 j established an analogue of this theorem for a 
more general setting, where in particular it implies a non-Gaussian limiting 
distribution of Fa, for any lattice AcZ 2 . 

However, the object of our interest is slightly different. Rather than 
counting lattice points in the circle of varying radius t, we will do the same 
for annuli. More precisely, we define 

N A (t, p) :=N A (t + p)-N A (t), 

that is, the number of A-points inside the annulus of inner radius t and width 
p. The "expected" value is the area -^^{2tp + p 2 ), and the corresponding 
normalized remainder term is 



S A (t, p) :-- 



N A (t + p)-N A (t)- 1 ^ x (2tp + p 2 



The statistics of S A (t, p) vary depending to the size of pit). Of our 
particular interest is the intermediate or macroscopic regime. Here p — > 0, 
but pt — > oo. A particular case of the conjecture of Bleher and Lebowitz 
[BL^ states that S A (t, p) has a Gaussian distribution. In 2004 Hughes and 
Rudnick |HRj established the Gaussian distribution for the unit circle, under 
an additional assumption that p(t) ^> t~ e for every e > 0. 

By a rotation and dilation (which does not essentially effect the counting 
function), we may assume, with no loss of generality, that A admits a basis 
one of whose elements is the vector (1,0), that is A = (l, a + (we 
make the natural identification of i with (0, 1)). In a previous paper jWj we 
already dealt with the problem of investigating the statistical properties of 
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the error term for rectangular lattice A = (l, i(3j. We established the limiting 
Gaussian distribution for the "generic" case in this 1-parameter family. 

Some of the work done in jffij extends quite naturally for the 2-parameter 
family of planar lattices (l, a + i(3}. That is, in the current work we will 
require algebraic independence of a and (3 as well as the "strong Diophantin- 
ity" of the pair (a, (3) (to be defined), rather than transcendence and strong 



Diopantinity of the aspect ratio of the ellipse, as in jW] . 

We say that a real number £ is strongly Diophantine, if for every fixed 

n 

natural n, there exists K\ > 0, such that for integers cij with a^oP ^ 0, 

3=0 



3=0 



1 

>»- -k: 



max a,- 

0<i<" 



It was shown by Mahler |MAH| . that this property holds for a "generic" real 
number. We say that a pair of numbers (a, (3) is strongly Diophantine, if 
for every fixed natural n, there exists a number K\ > 0, such that for every 
integral polynomial p(x, y) = Yl a i,j xt y : ' of degree < n, we have 

i+j<n 

\p(a, (3)\ > n J 



max \a,i t j 

i+j<n ' 



whenever p(a,f3) ^ 0. This holds for almost all real pairs (a, see sec- 
tion o 

Theorem 1.1. Let A = ^1, a + i/3^ where (a, (3) is algebraically independent 
and strongly Diophantine pair of real numbers. Assume that p = p(T) — > ; 
but for every 5 > 0, p ^> T~ 5 . Then for every interval A, 

lim l-meas[t G [T, 2T] : e A = — L [ e~^dx, (1) 



A 



where the variance is given by 



^■-j-P- (2) 



Remark: Note that the variance a 2 is a-independent, since the determi- 
nant det(A) = (3. 

One of the features of a rectangular lattice is that it is quite easy to 
show that the number of so-called close pairs of lattice points or pairs of 
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points lying within a narrow annulus is bounded by essentially its average 
(see lemma 5.2 of W ). This particular feature of the rectangular lattices 
was exploited while reducing the computation of the moments to the ones 
of a smooth counting function (we call it " unsmoothing" ) . In order to prove 
an analogous bound for a general lattice, we extend a result from Eskin, 
Margulis and Mozes l'.MM for our needs to obtain proposition 13.11 We 
believe that this proposition is of independent interest. 

2 The distribution of Sa,m,l 

In this section, we are interested in the distribution of the smooth version of 
S\(t, p), denoted 5a,m,l(£), where L := - and M is the smoothing parame- 
ter. Just as in and |HR| . 



where N\ t M is the smooth version of N\, computed by means of convolution 
of the characteristic function of the unit ball with ip, a smooth function with 
a compact support (see |HR| or jffij for details). We assume that for every 
5 > 0, L = L(T) = 0(T S ), which corresponds to the assumption of theorem 
II. II regarding p :— -g. 

Rather than drawing t at random from [T, 2T] with a uniform distribu- 
tion, we prefer to work with smooth densities: introduce u > 0, a smooth 
function of total mass unity, such that both uj and Cj are rapidly decaying, 
namely 





(3) 




1 




1 





for every A > 0. Define the averaging operator 



oo 




— oo 



and let P W) t be the associated probability measure: 




— oo 
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Remark: In what follows, we will suppress the explicit dependency on T, 
whenever convenient. 



Theorem 2.1. Suppose that M(T) and L(T) are increasing to infinity with 
T, such that M = 0(T 5 ) for all 5 > 0, and L/y/M -> 0. Then if (a, (3) 
is an algebraically independent strongly Diophantine pair, we have for A = 
(l, a + i(3), 



J Sa.jw l 
t-*oc I a J 

A 



,2 



li m T { eA\ = \ e~dx, 

T-*oc 

for any interval A, where 



Definition: A tuple of real numbers (a\, . . . , a n ) G M n is called Diophan- 
tine, if there exists a number i-T > 0, such that for every integer tuple {aj}" =0 , 

1 



a + 22 ai0Li 
i=i 



» ^> (5) 



where o = max \aA. Khintchine proved that almost all tuples in M n are 

0<i<n 

Diophantine (see, e.g. jSj, pages 60-63). 
Denote the dual lattice 

We assume for the rest of current section that the set of squared norms 
of A* satisfy the Diophantine property, which means that (a 2 , a/3, (3 2 ) is 
a Diophantine triple of numbers. We may assume the Diophantinity of 
(a 2 , af3, (3 2 ), since theorem ll.il fand theorem 12. 1J1 assume (a, 0) is strongly 
Diophantine, which is obviously a stronger assumption. 

We use the following approximation to NA,Ai{t) (see e.g [SE], lemma 4.1): 

Lemma 2.2. As t — > oo ; 

* t \ ^t 2 Vi ^ cos (2nt\k\ + f ) 7 / Ijfel \ / 1 \ 
fceA*\{o} 1 1 

where, again, A* is the dual lattice. 
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By the definition of Sa,m,l in 
sum in (JBJ) we obtain the following 



and appropriately manipulating the 



Corollary 2.3. 



sm 



SA,M, L (t)-— 

keA*\{0} 

1 



TTjfcj 

L 



sm 



2L 



(7) 



One should note that ip being compactly supported means that the sum 
essentially truncates at \k\ p 



M. 

Unlike the standard lattice, clearly there are no nontrivial multiplicities 
in A, that is 

Lemma 2.4. Let dj = rrij + n,j(a + if3) G A, j = 1, 2, with an irrational a 
such that 7 ^ Q(a)- Then if \a~[\ = \a%\, either n\ = n 2 and mi = m 2 or 
ni = —n 2 and n 2 = — m 2 . 

Proof of theorem \2.1\ We will show that the moments of Sa,m, l correspond- 
ing to the smooth probability space converge to the moments of the normal 
distribution with zero mean and variance which is given by theorem l2.ll This 
allows us to deduce that the distribution of Sa,m,l converges to the normal 
distribution as T — > oo, precisely in the sense of theorem 12.11 
First, we show that the mean is O(^). Since to is real, 



sm 




3m< o)( — T|A;|)e 



■ / i i 



T A \k[ 



for any A > 0, where we have used the rapid decay of Co. Thus 



Sa, 



M, L 



E 

T A \k\ A+3 / 2 



+ 



<0 



due to the convergence of 



i 



Now define 



fceA*\{o} 



|fc|A+3/2 



, for A > \ 



M 



A,m ■" 




sm 



2L 



M' 
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Then from (JJJ), the binomial formula and the Cauchy-Schwartz inequality, 

(wr)=*w°(x;(7)^P) 

Proposition 12.51 together with proposition 12.81 allow us to deduce the 
result of theorem 12.11 for an algebraically independent strongly Diophan- 
tine (£, 77) := (— f , 4). Clearly, (a, /3) being algebraically independent and 
strongly Diophantine is sufficient. □ 

2.1 The variance 

The computation of the variance is done in two steps. First, we reduce the 
main contribution to the diagonal terms, using the assumption on the pair 
(a, (3) (i.e. (a 2 , a/3, (3 2 ) is Diophantine). Then we compute the contribution 
of the diagonal terms. We sketch these steps, since they are very close to the 
corresponding one |Wj . 

Suppose that the triple (a 2 , a/3, f3 2 ) satisfies (0). 

Proposition 2.5. If M = 0{T 1 ^ K+1 / 2+5 ^) for fixed 5 > 0, then the variance 
of Sa m l is asymptotic to 



sin 2 2H 
a 2 ' x ~ V / ;,2 



fceA*\{0} 11 



If L->oo, but L/VM -> 0, i/ien 

2 

rr ~ 

/3L 



9 47T 

a 2 ~ — (9) 



Proof. Expanding out (jHJ), we have 

-(f) S in(?)«|)^(|) 



• M ^ 2 = ^ E 



fc,ieA*\{o} i i i i 

x ( sin ( 2tt ( * + -L V| + ^ j S in hit (t + ^] |j| + ^ 



(10) 
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It is easy to check that the average of the second line of the previous equation 
is: 

1 



4 



(T(\k\-\l\))e 



«r(l/L)(|2l-|£|) 



+ 



u;(T{\l\-\k\))e i ^ L ^-^+ 
u(T(\k\ + |Ii)) e --(V2+(i/i)(l^l+l«f))_ 



Recall that the support condition on ip means that k and I are both con- 
strained to be of length 0{\fM). Thus the off-diagonal contribution (that is 
for | A; | ^ |/| ) of the first two lines of (fTTj) is 



fc,feA*\{0} 

ifci, \k'\<vif 



M A(K+l/2) M A(K+l/2)+2 

< ^ <T 



— B 



J^A 



for every B > 0, by Diophantinity of (a, a/3, (3 2 ). 

Obviously, the contribution to (fTUjl of the two last lines of (fTT]) is neg- 
ligible both in the diagonal and off-diagonal cases, justifying the diagonal 
approximation of (fTU|) in the first statement of the proposition, and we omit 
the rest of the proof. □ 



2.2 The higher moments 

In order to compute the higher moments we will prove that the main con- 
tribution comes from the so-called diagonal terms (to be explained later). 
In order to bound the contribution of the off- diagonal terms, we will use 
the following theorem, which is a consequence of the work of Kleinbock and 
Margulis |KMj . The contribution of the diagonal terms is computed exactly 
in the same manner it was done in IWI. and so we will omit it here. 



Theorem 2.6. Let an integer n be given. Then almost all pairs of real num- 
bers (£, rf) e M. 2 satisfy the following property: there exists a number Ki 6 N 
such that for every integer polynomial of 2 variables p(x, y) = Yl a i,j x% V^ 

i+j<n 

with degree < n, we have 



|p(6, v)\ > h 



where h = max \a,ij\ is the height of p. The constant involved in the " ^> 

i+j<n ' 

notation depends only on £, rj and n. 



8 



We will remark that theorem A in |KM| is much more general when the 



result we are using. As a matter of fact, we have the inequality 

|&0 + &l/l(aO + ... + &n/n(aO| >e J^ e 

with bi G Z and 

h := max \bA. 

0<i<n 

The inequality above holds for every e > for a wide class of functions 
fi : U — *■ R, for almost all x G U, where U C lR m is an open subset. Here we 
use this inequality for the monomials. 

Definition: We call the pairs (£, 77) which satisfy for all natural n the 
property of theorem 12.61 strongly Diophantine. Thus theorem 12. 61 states that 
almost all real pairs of numbers are strongly Diophantine. 



Remark: Simon Kristensen KE| has recently shown, that the set of all 
pairs (£, 77) G M 2 which fail to be strongly Diophantine has Hausdorff dimen- 
sion 1. 

Obviously, strong Diophantinity of (£, 77) implies Diophantinity of any 
ra-tuple of real numbers which consists of any set of monomials in £ and 77. 
Moreover, (£, 77) is strongly Diophantine iff (— 2, I) is such. 

We have the following analogue of lemma 4.7 in j^j, which will eventually 
allow us to exploit the strong Diophantinity of (a, (3). 

Lemma 2.7. // (£, 77) is strongly Diophantine, then it satisfies the following 
property: for any fixed natural m, there exists K G N ; such that if 

zj = a) + b)i 2 + lajbji + b)r) 2 < M, 

m 

and €j = ±1 for j = 1, . . . , m, with integral aj, bj and if ^2 £jy/Zj 7^ 0, then 

i=i 

m 

\^2e jy /Zi\>M- K , (12) 

where the constant involved in the " ^> " notation depends only on 77 and m. 
The proof is essentially the same as the one of lemma 4.7 from |Wj . 

m 

considering the product Q of numbers of the form Sj^yz] over all possible 

3=1 

signs 5j. Here we use the Diophantinity of the real tuple (£, 77) rather than 
of a single real number. 
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Proposition 2.8. Let m G N be given. Suppose that A = (1, a + i(5), 
such that the pair (£, rj) := (— % , 4) zs algebraically independent strongly 
Diophantine, which satisfy the property of lemma \27\ for the given m, with 
K = K m . Then if Ai = 0(T K m\ for some 5 > 0, and if L — > oo such that 
L/y/M — > 0, the following holds: 

M^ { — r f^ + 0(^), mis even 



O(^), mis odd 

Proof. Expanding out (JHJ), we have 

' ""'V(^) 



sm 



■Ma,™ - JJ 



fc*i,...,CeA*\{o}i=i 1 jl (13) 



x 



m , 1 



)|* 



7T 



Now, 



m , 1 



/ j Orrinm \ / 4 J 1 J 1 / 



g 6J ((i/r)[^[+i/4) 



2"V 

m _, 

We call a term of the summation in (|T3*j) with — diagonal, and 

i=i 

o/f- diagonal otherwise. Due to lemma l2~7| the contribution of the off-diagonal 
terms is: 



fcl,...,fe m 6A*\{0} 

for every A > 0, by the rapid decay of Qj and our assumption regarding M. 

Since m is constant, this allows us to reduce the sum to the diagonal 
terms. In order to be able to sum over all the diagonal terms we need the 
following analogue of a well-known theorem due to Besicovitch [BS] about 
incommensurability of square roots of integers. 
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Proposition 2.9. Suppose that £ and rj are algebraically independent, and 

z j = a 2 J +2a 1 b^ + b 2 J (e + v), (14) 

such that (a.,-, bj) G are all different primitive vectors, for 1 < j < m. 
Then {y/Zj}] 1 ^ are linearly independent over Q. 

The last proposition is an immediate consequence of a theorem proved in 
the appendix of |BL2j . 

Computing the contribution of the diagonal terms is done literally the 
same way it was done in jWj and thus it is omitted here. In order to be 
able to sum over the diagonal terms, we use here proposition ESI rather than 
proposition 3.2 in IWj . 

□ 

3 Bounding the number of close pairs of lat- 
tice points 

Roughly speaking, we say that a pair of lattice points, n and n' is close, if 
I \n\ — \n'\ I is small. We would like to show that this phenomenon is rare. This 
is closely related to the Oppenheim conjecture, as \n\ 2 — \n'\ 2 is a quadratic 
form on the coefficients of n and n' . In order to establish a quantative 
result, we use a technique developed in a paper by Eskin, Margulis and 
Mozes [KM Mj . 

3.1 Statement of the results 

The ultimate goal of this section is to establish the following 
Proposition 3.1. Let A be a lattice and denote 

A(R, 5) := {(k, I) G A : R < \k\ 2 < 2R, \k\ 2 < \t\ 2 < \k\ 2 + 5}. (15) 

Then if 5 > 1, such that 5 = o{R), we have 

#A(R,S) < R5- log R 

In order to prove this result, we note that evaluating the size of A(R, 5) 
is equivalent to counting integer points v G M 4 with T < \\v\\ < IT such that 

< Qi(v) < 5, 
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where Qi is a quadratic form of signature (2, 2), given explicitly by 

Qi(v) = ( Vl + v 2 a) 2 + (v 2 (3) 2 - (v 3 + v A af - (v 4 f3) 2 . (16) 

For a fixed 5 > and a large R, this situation was considered extensively 
by Eskin, Margulis and Mozes |EMM| . We will examine how the constants 
involved in their result depend on 5, and find out that there is a linear 
dependency, which is what we essentially need. The author wishes to thank 
Alex Eskin for his assistance with this matter. 

Remark: For our purposes we need a weaker result: 

#A(R, 5) < e R5 ■ R e , 

for every e > 0. If A is a rectangular lattice (i.e. a = 0), then this result 
follows from properties of the divisor function (see e.g. |BLj . lemma 3.2). 

Theorem 2.3 in [EMMJ considers a more general setting than proposition 
13.11 We state here theorem 2.3 from EMMJ (see theorem 13. 2j) . It follows 
from theorem 3.3 from |EMMj . which will be stated as well (see theorem 13. 3j) . 
Then we give an outline of the proof of theorem 2.3 of |EMM| . and inspect 
the dependency on 5 of the constants involved. 

3.2 Theorems 2.3 and 3.3 from jEMMj 

Let A be a lattice in R™. We say that a subspace L C M n is A-rational, if 
L R A is a lattice in L. We need the following definitions: 

Definitions: 

L is a A — rational subspace of dimension ij, 
where 

d A (L) := volihj (L fl A)). 

Also 

ck(A) := max a* (A). 

0<i<n 

Since the space of unimodular lattices is canonically isomorphic to 
SL(n, M.)/SL(n, Z), the notation a(g) makes sense for g G G := SL(n, R). 

For a bounded function / : R n — > R, with |/| < M, which vanishes 
outside a ball B(0, R), define / : SL(n, R) — ► R by the following formula: 

fig) ■= E /M- 



t(A) :=sup {rf^Z) 
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Lemma 3.1 in |S2j implies that 

f{g) < ca(g), (17) 

where c = c(f) is an explicit constant constant 

c(/) = c M max(l, J R n ), 

for some constant c = c (n), independent on f. In section EP1 we prove a 
stronger result, assuming some additional information about the support of 
/• 

Let Qq be a quadratic form defined by 



p n— 1 

i=2 i=p+l 

Since 

(u x + v n ) 2 - (vi - v n ) 

VlV n = 



vl 



2 

Qo is of signature p, q. Obviously, G := SL(n, R) acts on the space of 
quadratic forms of signature (p, g), and discriminant ±1, = 0(p, g) by: 

Q*{v) := QM- 

Moreover, by the well known classification of quadratic forms, O is the orbit 
of Qo under this action. 

In our case the signature is (p, q) = (2, 2) and n = 4. We fix an element 
hi G G with Q hl = Qi, where Qi is given by (JT5j) . There exists a constant 
r > 0, such that for every i)6i 4 , 

t^IMI < \\hiv\\ < t\\v\\. (18) 

We may assume, with no loss of generality that r > 1. 

Let if := StabQ Q (G). Then the natural mophism ii\G — > 0(p,q) is a 
homeomorphism. Define a 1-parameter family a t £ G by: 

e~*ei, i = l 
ate, = < ej, z = 2, . . . , n - 1 . 

Clearly, a t G if. Furthermore, let K be the subgroup of G consisting of 
orthogonal matrices, and denote K := H C\K. 
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Let (a, b) £ R 2 be given and let Q : R n — > R be any quadratic form. The 
object of our interest is: 

V {a>b) (Z) = Vg 6) (Z) = {x £ Z n : a < Q(z) < 6}. 

Theorem 2.3 states, in our case: 

Theorem 3.2 (Theorem 2.3 from [EMM]). Let Q = {v £ R 4 | < 

z/(t>/||t>||)} ; where v is a nonnegative continuous function on S 3 . Then we 
have: 

#v ( J 6) (z)nra<cT 2 io g T, 

where the constant c depends only on (a, b). 

The proof of theorem 13. 21 relies on theorem 3.3 from |EMMj . and we give 
here a particular case of this theorem 

Theorem 3.3 (Theorem 3.3 from |EMMJ). For any (fixed) lattice A in 
R 4 , 

1 f 

sup - / a( y a t kA)dm( y k) < oo, 
t>i t J 

K 

where the upper bound is universal. 



3.3 Outline of the proof of theorem 13.21 : 

Step 1: Define 

J/(r,C) = -2 I f{r,x 2 , x 3 , x 4 )dx 2 dx 3 , (19) 



where 

C - A + %l 



X,{ 



2r 



Lemma 3.6 in [EMM states that Jf is approximable by means of an 
integral over the compact subgroup K. More precisely, there is some constant 
C > 0, such that for every e > 0, 



C-e 2 *y f{atkv)u{k- l e x )dm{k) - J f {\\v\\e~\ Qo(v)Mjj^j|) 

K 

with e*, ||f || > T for some T > 0. 



< e (20) 
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Step 2: Choose a continuous nonnegative function / on = {x\ > 0} 
which vanishes outside a compact set so that 

J/(r,C)>l + e 

on [t -1 , 2t] x [a, b). We will show later, how one can choose /. 

Step 3: Denote T = e*, and suppose that T < \\v\\ < 2T and a < 

Qo(hv) < b. Then by (HHJ), J/OlMll^ -1 , <?o(M)) > 1 + e, and by for 
a sufficiently large £, 

C -T 2 J f(a t kh 1 v)dm(k) > 1, (21) 

A' 

for T < \\v\\ < 2T and 

a < Qq(v) < b. (22) 

Step 4: Summing over all v G Z 4 with (J22J) and T < < 2T, we 
obtain: 

#V(«,6)(Z) n [T, 2T]S 3 <Y,C-T 2 I f(a t kh lV )dm(k) 

= C - T 2 [ f{a t kh 1 )dm{k) 



-a 

K 



(23) 



using the nonnegativity of /. 
Step 5: By (fTT|). is 

< C ■ c(f) ■ T 2 J a{a t khx)dm{k). 



K 



Step 6: The result of theorem 2.3 is obtained by using theorem 13.31 on the 
last expression. 

3.4 (5-dependency: 

In this section we assume that (a, b) = (0, 5), which suits the definition of 
the set A(R, 5), (|15)1. One should notice that there only 3 5-dependent steps: 
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• Choosing / in step 2, such that Jf > 1 +e on [r _1 , 2r) x [0, 5]. We will 
construct a family of functions fs with an universal bound \fs\ < M, such 
that fs vanishes outside of a compact set which is only slightly larger than 

V(S) = [r-\ 2r] x [-1, -I] 2 x [0, y]. (24) 

This is done in section 13.4.11 

• The dependency of T of step 3, so that the usage oflemma3.6in [EMM] 
is legitimate. For this purpose we will have to examine the proof of this 
lemma. This is done in section 13.4.21 

• The constant c in (JTTj). We would like to establish a linear dependency 
on S. This is straightforward, once we are able to control the number of 
integral points in a domain defined by (|24j). This is done in section 13.4.31 

3.4.1 Choosing fg: 

Notation: For a set U cR", and e > 0, denote 

U e := {i G 1" : max \x{ — yi\ < e, for some y G U}. 

l<i<n 

Choose a nonnegative continuous function / , on which vanishes out- 
side a compact set, such that its support, Ef , slightly exceeds the set V(l). 
More precisely, V(l) C Ef C V"(l)i for some 5o > 0. By the uniform 
continuity of /, there are eo, So > 0, such that if max \x{ — x°\ < So, then 

l<i<4 

f(x) > e , for every x° = (rr$,0, 0, x° 4 ) G V(l). 

Thus for (r, () G [r" 1 , 2r] x [0, 5], the contribution of [So, So} 2 to J/ is 
> e • (2So) 2 . Multiplying / by a suitable factor, and by the linearity of J/ , 
we may assume that this contribution is at least 1 + e. 

Now define fs(xi, ■ ■ ■ , x±) := fo(%i, x 2 , x 3 , ^). We have for S > 1 

(-xl + x 2 C/2r (x 2 /VS) 2 (x 3 /VS) 2 
2r5 5 2r 2r 

Thus for 8 > 1, if (r, Q G [r _1 , 2r] x [0, 5] and for i = 2, 3, |a?<| < 5 , /« 
satisfies: 

/ 5 (r, x 2 , x 3 , x 4 ) > e , 
and therefore the contribution of this domain to Jf s is 

> e (2S) 2 > 1 + e 

by our assumption. 

By the construction, the family {/^j has a universal upper bound M 
which is the one of fo- 



ld 



3.4.2 How large is T 

The proof of lemma 3.6 from |EMMj works well along the same lines, as long 

as 

f(a t x) ^ (25) 

implies that for t — > oo, converges to t\ = (1, 0, 0, 0). Now, since 

a t preserves Xix 4 , (J23j) implies for the particular choice of / = f$ in section 

E3U 

\xix±\ = 0(5); x\ ^> T. 

Thus 

\\x\\= Xl + 0(^) + 0(l), 
and so, as long as 8 = o(T), x/\\x\\ indeed converges to e\. 

3.4.3 Bounding integral points in V^: 
Lemma 3.4. Let V(5) defined by 

V(8) = [r-\ 2r] x [-1, -l]- 2 x [0, f}. (26) 

for some constant r and n > 3. Let g G SL(n, IR) and denote 

N(g, 6) := #V(S) n gIP. 

Then for 8 > 1, 



N(g, 8) - 



2 n ~ 2 (2r -r- l )8 



det g 



n— 1 1 



vol(Li/(gZ n n Li) 



for some g-rational subspaces Li of M 4 of dimension i, where c$ = c^{n) 
depends only on n. 

A direct consequence of lemma 13.41 is the following 

Corollary 3.5. Let f : R" — > R be a nonnegative function which vanishes 
outside a compact set E. Suppose that E C V e (8) for some e > 0. Then for 
8 > 1, (fTTj) is satisfied with 

c{f) = c 3 ■ M8, 
where the constant C3 depends on n only. 

In order to prove lemma E3J we shall need the following: 
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Lemma 3.6. Let A C K n be a m- dimensional lattice, and let 



(\ 



\ 



\ 



7 



(27) 



an n- dimensional linear transformation. Then for t > we have 

det A t A < t det A. 



(2f 



Proof. We may assume that m < n, since if m = n, we obviously have an 
equality. Let v±, . . . , v m the basis of A and denote for every i, Ui G IR n_1 the 
vector, which consists of first n — 1 coordinates of t>j. Also, let G K be 
the last coordinate of t>j. By switching vectors, if necessary, we may assume 
X\ 7^ 0. We consider the function 



f(t):= (det A t Af 



as a function of i G 
Obviously, 



f(t) = det ( < Ui, Uj > +XiXjt 2 ) 



l<i, j<m' 



Substracting ^ times the first row from any other, we obtain: 



/(*) 



< U\, Uj > +X\Xjt 2 
< U 2 , Uj > < Ui, Uj > 



< U m , Uj > --^ < Ui, Uj > 



and by the multilinearity property of the determinant, / is a linear function 
oft 2 . Write 

fit) = a (t 2 -l) + bt 2 . 

Thus 

6 = /(l); o=-/(0), 

and so b = det A, and a = — det < Ui, Uj >< 0, being minus the determinant 
of a Gram matrix. Therefore, 

(det A t A) 2 - t 2 det A = a{t 2 - 1) < 

for t > 1, implying (|27)l . □ 
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Proof of lemma U~J We will prove the lemma, assuming (3 = 2. However, 
it implies the result of the lemma for any (3, affecting only C5. Let 5 > 0. 
Trivially, 

N(g,6)=N(g ,l), 

where go = Aj x g with As given by (J2*?)) . Let Ai < A2 < . . . < A n be 
the successive minima of go, and pick linearly independent lattice points 
t>i, . . . , v n with ||t>j|| = Aj. Denote Mj the linear space spanned by V\, . . . , Vi 
and the lattice A, = g Z n fl Mj. 

First, assume that A n < Jt 2 + (n — 1) =: r. Now, by Gauss' argument, 



N(g , 1) - 



2"- 1 (2r-r- 1 )<5 



det g 



< 



det g 



v 01(H), 



where 

S := {x : dzstfo 9^(1)) < ^A n }. 

Now, for A n < r, 

uo/(£) <C A„, 

where the constant implied in the " <C "-notation depends on n only (this is 
obvious for A n < 5-, and trivial otherwise, since for A n < r, vol(E) = 0(1)). 
Thus, 



N(g Q , 1) 



T-\2t-t- 1 )5 



det (7 



< 



A, 



1 



1 



< 



det# detA n _i 
6 



vol(M n -i/M n -i n g Z n ) ~ vol(A s M n ^/A s M n ^ n ^Z") 
Next, suppose that A n > r. Then, 

7(<J) n # z n c V(8) n A„-i. 

Thus, by the induction hypothesis, the number of such points is: 

fc-i fe-i 
^ C4 Edet(A-Y = E 



1 



i=0 
fc-1 

i=0 



i=0 



vd(Mi/Mi n p Z n ) 



1 



Since A„ > r, we have 
1 



1 1 1 

< -; 77- < 



detg A n detg/A n detg/A n Ai 
and we're done by defining Lj := A^Mj. 



An-l 



□ 
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4 Unsmoothing 



4.1 An asymptotic formula for N\ 

We need an asymptotic formula for the sharp counting function N\. Unlike 
the case of the standard lattice, Z 2 , in order to have a good control over the 
error terms we should use some Diophantine properties of the lattice we are 
working with. We adapt the following notations: 

Let A be a lattice and t > a real variable. Denote the set of squared 
norms of A by 

SN A = {\n\ 2 : neA}. 

Suppose we have a function 5 A '■ SN\ — > R, such that given fee A, there are 
no vectors neA with < ||n| 2 — \k\ 2 \ < 5a(|^| 2 )- That is, 

A n {n e A : \k\ 2 - 5 A (\k\ 2 ) < \n\ 2 < \k\ 2 + 6 A (\k\ 2 )} = A^, 

where 

A y := {n E A : \n\ = y}. 

Extend S\ to R by defining 5\(x) : = 5 A ( | k | 2 ) , where k e A minimizes | x — \ k \ 2 \ 
(in the case there is any ambiguity, that is if x = ^ ^" 2 ^ for vectors n\, n 2 E 
A with consecutive increasing norms, choose k := tTi). We have the following 
lemma: 

Lemma 4.1. For every a > 0, c > 1, 

N ^)=-/-t e co3(2 ;f +f) +^> 

P P 71 - , r , \k s 

+ O (^) + O • ( log * + log(5A(t 2 )) ) 
+ oflogiV + log(Mt 2 )) 



As a typical example of such a function, 5\, for A = (1, a + with a 
Diophantine (a, a 2 , 7 2 ), we may choose 5\(y) = where c is a constant. In 

this example, if A 3 k = (a,b), then by lemma E3J As = ±(a, b), provided 
that 7 is irrational. 

The proof of this lemma is essentially the same as the one of lemma 5.1 
in jWj, starting from 

1 



4^ |£|2< , _ v {{m + na) 2 + (l3n) 2 Y 
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Proposition 4.2. Let a lattice A = (1, ct + i/3) with a Diophantine triple of 
numbers (a 2 , a/3, f3 2 ) be given. Suppose that L — *■ oo as T — > oo and choose 
M, such that L/y/M -> 0, but M = 0(T S ) for every S > as T -> oo. 
Suppose furthermore, that M = O(L S0 ) for some (fixed) so > 0. T/ien 



The proof of proposition 14.21 proceeds along the same lines as the one 
of proposition 6.1 in [W], using again an asymptotic formula for the sharp 
counting function, given by lemma 14.11 The only difference is that here we 
use proposition 13 . 1 1 rather than lemma 6.2 from |Wj . 

Once we have proposition 14.21 in our hands, the proof of our main result, 
namely, theorem 11.11 proceeds along the same lines as the one of theorem 1.1 
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